Nash County
Generated Data with Fake Privacy: Hidden Dangers of Fine-tuning Large Language Models on Generated Data
Akkus, Atilla, Li, Mingjie, Chu, Junjie, Backes, Michael, Zhang, Yang, Sav, Sinem
Large language models (LLMs) have shown considerable success in a range of domain-specific tasks, especially after fine-tuning. However, fine-tuning with real-world data usually leads to privacy risks, particularly when the fine-tuning samples exist in the pre-training data. To avoid the shortcomings of real data, developers often employ methods to automatically generate synthetic data for fine-tuning, as data generated by traditional models are often far away from the real-world pertaining data. However, given the advanced capabilities of LLMs, the distinction between real data and LLM-generated data has become negligible, which may also lead to privacy risks like real data. In this paper, we present an empirical analysis of this underexplored issue by investigating a key question: "Does fine-tuning with LLM-generated data enhance privacy, or does it pose additional privacy risks?" Based on the structure of LLM's generated data, our research focuses on two primary approaches to fine-tuning with generated data: supervised fine-tuning with unstructured generated data and self-instruct tuning. The number of successful Personal Information Identifier (PII) extractions for Pythia after fine-tuning our generated data raised over $20\%$. Furthermore, the ROC-AUC score of membership inference attacks for Pythia-6.9b after self-instruct methods also achieves more than $40\%$ improvements on ROC-AUC score than base models. The results indicate the potential privacy risks in LLMs when fine-tuning with the generated data.
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- North America > United States > North Carolina > Nash County > Rocky Mount (0.04)
- Law (1.00)
- Information Technology > Security & Privacy (1.00)
Biden repeats dubious claim about son's death in call to fallen service member's family: 'The nerve'
During a call with the parents of fallen service member Spc. Kennedy Ladon Sanders, Biden claimed he "lost" his son, Beau Biden, to the war in Iraq. President Biden repeated a dubious claim about the death of his son, Beau Biden, during a call with the parents of a U.S. service member who was recently killed in an attack on a base in Jordan near the border with Syria. While speaking on Tuesday to the parents of 24-year-old Specialist Kennedy Ladon Sanders, who lost her life in an Iran-backed drone strike this month in northeast Jordan that killed three service members total and injured 25 others, Biden said he lost his son to the war in Iraq. During the call, which was first shared by the Atlanta Journal Constitution, Biden told Shawn Sanders and Oneida Oliver-Sanders that their daughter was being posthumously promoted to sergeant.
- Asia > Middle East > Iraq (0.86)
- Asia > Middle East > Jordan (0.50)
- Asia > Middle East > Syria (0.37)
- (10 more...)
- Government > Regional Government > North America Government > United States Government (1.00)
- Government > Military (1.00)
Full-page ad in New York Times claims Tesla poses 'life-threatening danger to children'
As if Elon Musk did not have enough on his plate with Twitter, Tesla is now under fire in a full-page advertisement in the New York Times that warns its'Full Self-Driving presents a life-threatening danger to child pedestrians.' The ad, which cost about $150,000, is from software maker The Dawn Project and claims to highlight safety testing conducted by the firm in October. A video of the experiment suggests the system does not register or stop for small mannequins crossing a road, according to the group. The testing involved a man driving in a Tesla on a back road and running over child-size mannequins in his path. Using the Tesla Full Self-Driving Beta 10.69.2.2, which is the latest version of the system, the vehicle collided with a 29-inch mannequin at speeds as low as 15 miles per hour and it ran over a four-foot-tall one at 20 miles per hour.
- North America > United States > Washington > Snohomish County > Arlington (0.15)
- North America > United States > Texas > Montgomery County (0.15)
- North America > United States > North Carolina > Mecklenburg County > Charlotte (0.15)
- (10 more...)
- Transportation > Passenger (1.00)
- Transportation > Ground > Road (1.00)
- Law Enforcement & Public Safety > Crime Prevention & Enforcement (1.00)
- Automobiles & Trucks > Manufacturer (1.00)
Tesla's self-driving software confuses horse-drawn carriage on the highway with a semi-truck
January 22, 2018 in Culver City: A Tesla Model S hit the back of a fire truck parked at an accident in Culver City around 8:30 am on Interstate 405 using the cars Autopilot system. The Tesla, which was going 65mph, suffered'significant damage' and the firetruck was taken out of service for body work. May 30, 2018 in Laguna Beach: Authorities said a Tesla sedan in Autopilot mode crashed into a parked police cruiser in Laguna Beach. Laguna Beach Police Sgt. Jim Cota says the officer was not in the cruiser during the crash. He said the Tesla driver suffered minor injuries.
- North America > United States > California > Los Angeles County > Culver City (0.47)
- North America > United States > Washington > Snohomish County > Arlington (0.16)
- North America > United States > Texas > Montgomery County (0.16)
- (10 more...)
- Transportation > Passenger (1.00)
- Transportation > Ground > Road (1.00)
- Law Enforcement & Public Safety > Crime Prevention & Enforcement (1.00)
- Automobiles & Trucks > Manufacturer (1.00)
Tesla in full self-driving mode appears to run over a child-sized mannequin in 'test conditions'
A'deeply disturbing' video claims to show a Tesla in full self-driving mode running over a child-size mannequin during a test by a safety campaign group. The Dawn Project said the vehicle failed to detect the stationary dummy's presence in the road and hit it over and over again at an average speed of 25mph. It claims that the experiment was carried out under'controlled conditions' on a test track in California. Tesla, which was founded by billionaire entrepreneur Elon Musk, has been approached for a comment by MailOnline but is yet to respond to the video. The US National Highway Traffic Safety Administration (NHTSA) confirmed that it'currently has an open and active investigation of Tesla's Autopilot active driver assistance system'.
- North America > United States > Washington > Snohomish County > Arlington (0.15)
- North America > United States > Texas > Montgomery County (0.15)
- North America > United States > North Carolina > Mecklenburg County > Charlotte (0.15)
- (12 more...)
- Transportation > Ground > Road (1.00)
- Automobiles & Trucks > Manufacturer (1.00)
Tesla car in 'Full Self-Driving' mode hits a bollard on camera
A Tesla Model 3 car in'Full Self-Driving' mode has been captured colliding with a bike lane barrier post, in a potential setback for Elon Musk's firm. The footage was captured during a drive in downtown San Jose, California, by a YouTuber who goes by the name AI Addict, and provides the first recorded evidence that the feature has been directly responsible for an accident. It shows the latest version of Tesla's self-driving software, Full Self-Driving (FSD) Beta version 10.10, veering the Model 3 into the bollard separating a bike lane. Even though the driver is hitting the brakes and furiously spins the steering wheel away from the obstacle, the AI-powered FSD system hits the bollard with a big thud. Worryingly, at other points in the video the Model 3 appears to run a red light and attempts to go down a railroad track and later a tram lane.
- North America > United States > California > Santa Clara County > San Jose (0.25)
- North America > United States > Washington > Snohomish County > Arlington (0.15)
- North America > United States > Texas > Montgomery County (0.15)
- (13 more...)
- Transportation > Passenger (1.00)
- Transportation > Ground > Road (1.00)
- Transportation > Electric Vehicle (1.00)
- Automobiles & Trucks > Manufacturer (1.00)
Tesla on autopilot smacked into Florida Highway Patrol cruiser that stopped to help disabled vehicle
A Tesla Model 3 driving on'autopilot' smacked into a Florida Highway Patrol cruiser on Saturday morning, narrowly missing the driver of the cruiser who had stopped in order to help a disabled vehicle. The incident is the 12th such smash involving a Tesla on autopilot mode and an emergency vehicle. All the cars which have been struck had their lights flashing, or had deployed an emergency flare, illuminated warning sign or cones, raising questions about whether they may have confused the Tesla's sensors. Saturday's smash happened after when the 28-year-old trooper, who has not been named, stopped shortly after 5 am on August 28 on I-4 near downtown Orlando while responding to a broken down car. He put his emergency lights and was walking over to a disabled vehicle when the Tesla hit the cruiser's left side, according to a copy of the police report seen by DailyMail.com.
- North America > United States > Texas > Montgomery County (0.15)
- North America > United States > North Carolina > Mecklenburg County > Charlotte (0.15)
- North America > United States > Connecticut > Fairfield County > Norwalk (0.15)
- (12 more...)
- Transportation > Ground > Road (1.00)
- Law Enforcement & Public Safety > Crime Prevention & Enforcement (1.00)
- Automobiles & Trucks > Manufacturer (1.00)